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“If builders built buildings the way programmers 
write programs, then the first woodpecker that 
came along would destroy civilization.” 
— Gerald M. Weinberg/Weinberg’s Second Law © 2020 Philip Koopman 1 
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Software Quality Assurance (SQA) Fy A cats 


DEFINE 
TRAIN 


= Anti-Patterns: 
e Process steps are being skipped 


e Nobody tasked with ensuring SW 
process is actually being followed 








e Less than 5%-6% of effort on SQA AU DIT 
= SQA responsibilities: DIAGNOSE 
e Define & maintain software process definition FIX 


e Train on process and related skills 

e Audit to ensure process is being followed 

e Keep metrics & diagnose process-related failures 
e Coach/intervene to fix process failures 
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Audit: Is The Process Being Followed? ee 





= Every process step produces artifacts - ects 


ol > ~ — 
eo = 


e If it’s not written down, it didn’t happen \* 
- Audit says “yes, it happened” 

e Artifacts must be lightweight but useful 
— Artifacts are the arrows on V diagram 


m Process quality audits are more subtle ahem enpeenrenbeerrerrvernrserr 
e Some information from quality of written artifacts 
— Completeness — were all required fields filled out? 
— Internal consistency checks, e.g., traceability 
e Some information indirectly via process-related metrics 
— Are defects escaping to later process stages? 
e Sometimes direct observation (e.g., randomly attend peer reviews) 
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SQA Personnel As Coaches as 
= SQA defines the process | 
e With inputs from all stakeholders! 


e Keeper of the process diagram 
e Create/maintain templates and work aids 








= SQA conducts training 
e Initial training for new team members 
e Remedial coaching, guidance, etc. for process failures 


https://pixabay.com/en/softball-team-coach-sports-1485997/ 


=m SQA keeps records & metrics to ensure process is on track 
e Metrics should encourage high quality work products 
e Better to coach problems than punish them 
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One Reason Process Matters aie 


= Poor process: 
e Bugs escape to field 





Relative Cost to Fix Defects 
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Source: 
Davis 1993 


= Testing: 


Peer Development 
Ary 7 . @ a fei ae Stages e Can't even look for 
Are Cheap! a Coding bugs until it's | 
Testing Ca expensive to find and 
Defect Unit Test fix them 


Fixes Are 
Expensive! 


m Peer Reviews: 
e Find bugs while it is 
\ Maintenance still cheap to do so 
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SQA Best Practices = 

= SQA must have broad view of quality 
e Define & maintain processes 

e Audit & measure process effectiveness 


e Train & intervene to keep process 
conformance on track 


e About 5%-6% of staffing for SQA 





= SQA pitfalls 
e SQA is not testing (product defects); it’s about process defects 
e Avoid form over substance; technical quality matters! 
e Beware adversarial role of SQA (the “Process Police”) 
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https://xkcd.com/1700/ 


